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DETAILED ACTION 

Election/Restrictions 
1 . Restriction to one of the following invention is required under 35 U.S.C. 121 : 

Group I, claims 1-30 drawn to a method for accessing data from an enterprise 
data system via user voice input, which is classified under class 704, subclass 257. 

Group II, claims 31-34 drawn to a method for dialing telephone numbers via 
speech, which is classified under class 704, subclass 275. 

Inventions of groups I and II are related as combination and sub-combination. 
Inventions in this relationship are distinct if it can be shown that (1) the combination as 
claimed does not require the particulars of the sub-combination as claimed for 
patentability, and (2) that the sub-combination has utility by itself or in other 
combinations (MPEP § 806.05(c)). In the instant case, the combination as claimed 
does not require the particulars of the sub-combination as claimed because invention of 
group I does not require the specific steps in the method for determining a telephone 
number and connecting the telephone call to the called party. The sub-combination of 
group II has separate utility such as voice-controlled systems. 

During a telephone conversation with the applicant's attorney, Mr. Burnett on 
12/9/2004, an election was made with traverse to prosecute the invention of group I, 
claims 1-30. Affirmation of this election must be made by applicant in replying to this 
Office action. Claims 31-34 are withdrawn from further consideration by the examiner, 
37 CFR 1.142(b), as being drawn to a non-elected invention. 
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Claim Rejections - 35 USC § 102 
2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - (b) the invention was patented or described in a printed 
publication in this or a foreign country or in public use or on sale in this country, more than one year prior to 
the date of application for patent in the United States. 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 



3. Claims 21-27 are rejected under 35 U.S.C. 102(b) as being anticipated by 
Uppaluru (US Patent No. 5915001). 



4. Regarding claim 21, Uppaluru discloses a method for accessing an enterprise 
data system via a telephone, comprising: enabling a user to establish a telephone 
connection to a voice access system (toe operation of figure 1); authenticating the user 
with the voice access system using a login process in which the user is identified by a 
unique user identifier (col. 3, line 1-17, including PIN numbers entered using keypad or 
verbal); determining enterprise data system log-in data that enables the user to access 
the enterprise data system, based on the unique user identifier for the voice access 
system (col. 3, line 1-17); automatically logging the user into the enterprise data system 
using the enterprise data system log-in data (col. 3, line 1-17); providing a voice user 
interface that enables the user to navigate and query data from a plurality of domains 
using spoken navigation and natural language query commands (element 105 in figure 
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1), wherein each domain comprises data corresponding to a respective type of object in 
the enterprise data system (the personal voice web section in col. 11-15); and providing 
feedback data in a verbal format to the user via the telephone connection in response to 
spoken navigation and natural language query commands (col. 19, line 24-60), said 
feedback data including data corresponding to data retrieved from the enterprise data 
system in response to the natural language query commands and system prompts in 
response to the spoken navigation commands (col. 19, line 24-60). 

5. Regarding claims 22-23, Uppaluru further discloses the method of claim 21 , 
wherein the voice user interface includes a set of global voice commands that enables 
the user to jump from a current domain to a new domain (col. 8, lines 32-51, "next" and 
"previous" commands and/or col. 17, lines 37-57), and wherein the voice user interface 
includes voice commands that are context sensitive to a current navigation context of 
the user, such that the user may navigate to another navigation context from a current 
navigation context using navigation voice commands that are based, at least in pad, on 
the current navigation context of the user (col. 17, lines 37-57). 

6. Regarding claim 24, Uppaluru further discloses the method of claim 21 , further 
comprising: generating a data query to retrieve data from the enterprise data system, 
said data query returning a plurality of data sets pertaining to an object to which the ad 
hoc query corresponds to (col. 19, lines 56-60, "results"); and enabling the user to 
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browse the plurality of data sets using verbal input {col. 19, lines 32-45, "navigate 
appropriate hyperlinks"). 

7. Regarding claim 25, Uppaluru further disclose the method of claim 21 , further 
comprising: maintaining navigation tracking information for the user that identifies 
navigation locations the user has previously navigated to (col. 8, lines 32-51, the "next" 
command and/or col. 19, lines 1-60); and selecting system prompts based on the 
navigation tracking information for the user such that the user is presented with a 
different system prompt if the user has not previously navigated to a current navigation 
location than the user is presented with if the user has previously navigated to the 
current navigation location (col. 19, lines 1-60). 

8. Regarding claim 26, Uppaluru further disclose the method of claim 21 , wherein 
the ad hoc query comprises a request to retrieve data corresponding to a domain the 
user is currently in that is provided to the enterprise data system and returns a plurality 
of data sets comprising header data identifying items pertaining to the current domain, 
further comprising: enabling the user to browse the header data on an item-by-item 
basis using verbal navigation commands (col. 19, lines 32-45); and reading the header 
data corresponding to each item in response to a user navigation to that item (col. 19, 
lines 46-60). 
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9. Regarding claim 27, Uppaluru further discloses the method of claim 26, further 
comprising: enabling the user to request detail information corresponding to an item that 
is currently being browsed (coL 29, lines 24-60); retrieving detail information from the 
enterprise database corresponding to the item currently being browsed (coL 29, lines 
24-60)] and reading the detail information to the user via the telephone connection (co/. 
29, lines 24-60). 

10. Claims 28-29 are rejected under 35 U.S.C. 102(e) as being anticipated by 
Bennett et al. (US Patent No. 6633846). 

1 1 . Regarding claim 28, Bennett et al. disclose a method for accessing an enterprise 
data system via telephone using a voice access system, comprising: defining a set of 
grammars comprising a language and syntax in which data are stored as phonetic 
representations of the data (coL 12, lines 1-1 7)\ retrieving selected data from the 
enterprise data system (col. 25, lines 19-35)', pre-compiling at least a portion of the 
selected data into predefined forms corresponding to the set of grammars (coL 25, lines 
19-35)\ storing the pre-compiled data in a local database that is apart from the 
enterprise data system (co/. 25, lines 19-35)] enabling a user to request an ad hoc 
query be performed against data stored in the enterprise data system and/or local 
database using a spoken natural language query (Speech Input in figure 1)] converting 
the spoken natural language query into a data request and retrieving data from the 
enterprise data system and/or local database corresponding to the ad hoc query 
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(elements 182-184 in figure 1 and/or col. 24, line 56 to col. 25, line 12); and providing 
feedback data corresponding to data that are retrieved in a verbal format to the user via 
the telephone connection {col. 25, line 62 to col. 26, line 3 and figure 11C). 

12. Regarding claim 29, Bennett et al. further disclose the method of claim 28, 
wherein header data that are used to identify objects are stored in the local database 
while detail data corresponding to the objects are stored in the enterprise database (col. 
25, lines 19-35). 

1 3. Regarding claim 30, Bennett et al. further disclose the method of claim 28, further 
comprising: defining a set of objects for which data are to be pre-compiled (col. 25, lines 
19-47); defining a schedule identifying when data corresponding to the set of objects 
are to be pre-compiled (col. 25, lines 19-47); and pre-compiling data corresponding to 
those objects based on the schedule (col. 25, lines 19-47). 

Claim Rejections - 35 USC § 103 

14. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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15. Claims 1-11 and 15-20 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Bennett et al. (US Patent No. 6633846) in view of Uppaluru (US 
Patent No. 5915001). 

16. Regarding claims 1, 3 and 15-16, Bennett et al. disclose a method for accessing 
data from an enterprise data system via user voice input: enabling a user to establish a 
communications connection to a voice access system (the operation of figure 1)\ 
enabling the user to request an ad hoc query be performed against data stored by the 
enterprise data system using a spoken natural language query (Speech Input in figure 
1)\ converting the spoken natural language query into a data query and executing the 
data query to retrieve any data in the enterprise data system corresponding to the ad 
hoc query (elements 182-184 in figure 1 and/or col. 24, line 56 to col. 25, line 12)\ and 
providing feedback data corresponding to data retrieved from the enterprise data 
system in a verbal format to the user (col. 25, line 62 to col. 26, line 3 and figure 11C). 

Bennett et al. fail to specifically disclose the step of authenticating the user using 
a login process in which the user is identified by a unique voice user identifier; and 
transparently logging the user into the enterprise data system through use of 
information obtained during authentication of the user. However, Uppaluru teaches the 
step of authenticating the user using a login process in which the user is identified by a 
unique voice user identifier (col. 3, line 1-17, including PIN numbers entered using 
keypad or verbal)] and transparently logging the user into the enterprise data system 
through use of information obtained during authentication of the user (col. 3, line 1-17). 
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Since Bennett et al. and Uppaluru are analogous art because they are from the 
same field of endeavor, it would have been obvious to one of ordinary skill in the art at 
the time of invention to modify Bennett et al. by incorporating the teaching of Uppaluru 
in order to prevent unauthorized user from gaining access to services and to ensure 
security. 

1 7. Regarding claim 2, Bennett et al. further disclose the method of claim 1 , wherein 
the data query includes reference to a unique enterprise data system user identifier 
such that the ad hoc query returns user-specific data (col. 25, line 62 to col. 26, line 3 
and/or referring to figure 11C). 

18. Regarding claims 4 and 17, Bennett etal. further disclose the method of claim 1, 
further comprising: converting the spoken natural language query into a data request in 
an application-readable form (co/. 24, line 56 to col 25, line 12)\ identifying one or more 
objects and data criteria corresponding the spoken natural language query by 
processing the data request (col. 25, lines 1-12)] and formulating the data query based 
on any objects and data criteria that are identified (coA 25, lines 1-12). 

1 9. Regarding claims 5 and 1 8, Bennett et al. further disclose the method of claim 4, 
wherein the enterprise data system includes an object manager and data manager that 
are used to enable access to data stored in an enterprise database, further comprising: 
passing information corresponding to any objects and data criteria that are identified to 
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the object manager (col. 25, lines 1-61 and/or referring to figures 11A-B); formulating a 
database query based on the objects and data criteria passed to the object manager in 
consideration of enterprise database schema information available to the data manager 
(col. 25, lines 1-61 and/or referring to figures 1 1A-B); submitting the database query to 
the enterprise database (col. 25, lines 1-61 and/or referring to figures 11A-B); receiving 
a result set back from the enterprise database in response to the database query (col. 
25, lines 62 to col. 26, line 3 and/or referring figure 11C); and processing the result set 
to produce the feedback data (col. 25, lines 19-61). 

20. Regarding claim 6, Bennett et al. further disclose the method of claim 5, further 
comprising: extracting object data from the result set (col. 25, lines 19-35), but fail to 
specifically disclose the steps of defining a prompt and slotted data string corresponding 
to a grammatical form in which data are to be presented to a user; embedding the 
object data into slots in the prompt and slotted data string to produce the feedback data. 
However, Uppaluru further teaches the steps of defining a prompt and slotted data 
string corresponding to a grammatical form in which data are to be presented to a user 
(col. 19, line 45 to col. 20, line 34); embedding the object data into slots in the prompt 
and slotted data string to produce the feedback data (col. 19, line 45 col. 20, line 34). 

Since Bennett et al. and Uppaluru are analogous art because they are from the 
same field of endeavor, it would have been obvious to one of ordinary skill in the art at 
the time of invention to further modify Bennett et al. by incorporating the teaching of 
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Uppaluru in order to ease subscriber's access by automatically filling in the needed 
fields and guiding the user to input command step by step. 

21 . Regarding claim 7, Bennett et al. further disclose the method of claim 1 , wherein 
converting the spoken natural language query into the data query comprises: receiving 
user voice input as digital waveform data (Input Speech in figure 1)\ passing the digital 
waveform data to a voice recognition component (SRE 155 and 182 in figure 1)\ 
receiving application-readable data from the voice recognition component 
corresponding to the spoken natural language query (col. 25, lines 1-12)] and 
processing the application-readable data to determine what data the user desires to 
retrieve (col. 25, lines 1-47). 

22. Regarding claim 8, Bennett et al. further disclose the method of claim 2, further 
comprising: defining a grammar syntax language comprising a plurality of grammars 
specifying grammatical formatting of legal user inputs (col. 19, lines 27-67 and col. 27, 
lines 20-67); and determining what the user desires to retrieve by processing user voice 
input in consideration of the grammar syntax language (col. 19, lines 27-67). 

23. Regarding claim 9, Bennett et al. further disclose the method of claim 1 , wherein 
providing feedback data corresponding to data retrieved from the enterprise data 
system in a verbal format to the user comprises: defining a text string corresponding to 
a grammatical form in which data are to be presented to a user (speech output in figure 
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1)\ embedding data retrieved from the enterprise data system to form an embedded 
data text string (col. 25, line 62 to col. 26, line 3); passing the embedded data text string 
to a text-to-speech conversion component (TTS 159 in figure 1)\ receiving digital 
waveform data from the text-to-speech conversion component corresponding to the 
embedded data text string (Speech Output in element 158 in figure 1)\ streaming the 
digital waveform data to a device that produces an audible sound in response to 
processing the digital waveform data to produce a verbalized feedback to the user 
(Speech Output in element 158 in figure 1, audio unit is inherently included to produce 
the audible sound). 

Bennett et al. fail to disclose the step of embedding data retrieved from the 
enterprise data system in slots defined in the text and slotted data string to form an 
embedded data text string. However, Uppaluru further teaches the step of embedding 
data retrieved from the enterprise data system in slots defined in the text and slotted 
data string to form an embedded data text string (col. 19, line 45 to col. 20, line 34). 

Since Bennett et al. and Uppaluru are analogous art because they are from the 
same field of endeavor, it would have been obvious to one of ordinary skill in the art at 
the time of invention to further modify Bennett et al. by incorporating the teaching of 
Uppaluru in order to ease subscriber's access by automatically filling in the needed 
fields and guiding the user to input command step by step. 

24. Regarding claim 10, Bennett et al. fail to disclose the method of claim 9, wherein 
a plurality of text and slotted data strings are defined, each corresponding to a 
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respective system response, further comprising: determining a current navigation 
context of the user; and selecting an appropriate text and slotted data string from 
among said plurality of text/prompt and slotted data strings based, at least in pad, on 
the current navigation context of the user. However, Uppaluru further teach the steps of 
determining a current navigation context of the user (col. 18, line 45 to col. 19, line 60); 
and selecting an appropriate text/prompt and slotted data string from among said 
plurality of text and slotted data strings based, at least in pad-, on the current navigation 
context of the user (col. 18, line 45 to col. 19, line 60). 

Since Bennett et al. and Uppaluru are analogous art because they are from the 
same field of endeavor, it would have been obvious to one of ordinary skill in the art at 
the time of invention to further modify Bennett et al. by incorporating the teaching of 
Uppaluru in order to ease the subscriber's access. 



25. Regarding claim 1 1 , Bennett et al. fail to disclose the method of claim 9, wherein 
a plurality of text and slotted data strings are defined, each corresponding to a 
respective system response, further comprising: identifying attributes corresponding to 
data retrieved from the enterprise data system; and selecting an appropriate text/prompt 
and slotted data string from among said plurality of text and slotted data strings based, 
at least in pad, on any attributes corresponding to data retrieved from the enterprise 
data system that are identified. 

However, Uppaluru further teach the steps of identifying attributes corresponding 
to data retrieved from the enterprise data system (col. 18, line 45 to col. 19, line 60); 
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and selecting an appropriate text/prompt and slotted data string from among said 
plurality of text and slotted data strings based, at least in part, on any attributes 
corresponding to data retrieved from the enterprise data system that are identified (col. 
18, line 45 to col. 19, line 60). 

Since Bennett et al. and Uppaluru are analogous art because they are from the 
same field of endeavor, it would have been obvious to one of ordinary skill in the art at 
the time of invention to further modify Bennett et al. by incorporating the teaching of 
Uppaluru in order to ease the subscriber's access. 

26. Regarding claim 19, Bennett et al. further disclose the method of claim 18, 
wherein use of the object manager and data manager abstracts objects from how data 
corresponding to the objects are stored in the enterprise database such that a schema 
of the enterprise database may be changed without requiring any changes to any voice 
access system component that is external to the enterprise data system (Database 188, 
the database is simply a piece of memory, where data are entered/updated frequently 
ready to be accessed by the subscriber. The database is inherently independent of 
other processing units. Therefore, changing the contents of the database will not affect 
other processing units). 

27. Regarding claim 20, Bennett et al. fail to disclose the method of claim 15, further 
comprising: retrieving data pertaining to a selected object for the user from the 
enterprise data system through use of the unique user identifier upon login to the voice 
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access system; and providing feedback data corresponding to any data that are 
retrieved in a verbal format to the user via the communications connection. However, 
Uppaluru further teach the steps of retrieving data pertaining to a selected object for the 
user from the enterprise data system through use of the unique user identifier upon 
login to the voice access system (col. 19, lines 24-32); and providing feedback data 
corresponding to any data that are retrieved in a verbal format to the user via the 
communications connection (coL 19, lines 24-32). 

Since Bennett et al. and Uppaluru are analogous art because they are from the 
same field of endeavor, it would have been obvious to one of ordinary skill in the art at 
the time of invention to further modify Bennett et al. by incorporating the teaching of 
Uppaluru in order to assist use^in using the service. 

28. Claims 12-14 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Bennett et al. (US Patent No. 6633846) in view of Uppaluru (US Patent No. 5915001), 
and further in view of Denneberg et al. (US Patent No. 6724864). 

29. Regarding claim 12, Bennett et al. further disclose the method of claim 1, 
wherein providing feedback data corresponding to data retrieved from the enterprise 
data system in a verbal format to the user comprises: passing data retrieved from the 
enterprise data system to a text-to-speech conversion component (TTS 159 in figure 1)\ 
receiving text-to-speech (TTS) digital waveform data from the text-to-speech conversion 
component corresponding to the data passed to it {output of the TTS 159 in figure 1)\ an 
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audible sound in response to processing the digital waveform data to produce a 
verbalized feedback to the user (output of the TTS 159 in figure 1). 

Bennett et al. fail to specifically disclose the steps of storing a plurality of prompt 
audio files, each comprising prompt digital waveform data that when processed 
produces a verbalized prompt comprising one or more words; defining a prompt 
identifier and slotted data string specifying a grammatical form in which data are to be 
presented to a user by identifying prompt audio files to be streamed and defining in 
order specifying where data are to be inserted relative to any prompts audio files that 
are identified; streaming prompt and TTS digital waveform data to a device that 
produces; wherein portions of the prompt and TTS digital waveform data are streamed, 
in order, based on an ordera^ defined by the prompt identifier and slotted data string, 
and prompt digital waveform data is retrieved from prompt audio files corresponding to 
the prompt identifiers. 

However, Denneberg et al. teach the steps of storing a plurality of prompt audio 
files, each comprising prompt digital waveform data that when processed produces a 
verbalized prompt comprising one or more words (col. 4, line 26 to col. 5, line 33); 
defining a prompt identifier and slotted data string specifying a grammatical form in 
which data are to be presented to a user by identifying prompt audio files to be 
streamed and defining in order specifying where data are to be inserted relative to any 
prompts audio files that are identified (col. 13, lines 5-25); streaming prompt and TTS 
digital waveform data to a device that produces (col. 4, line 26 to col. 5, line 33); 
wherein portions of the prompt and TTS digital waveform data are streamed, in order, 
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based on an ordered defined by the prompt identifier and slotted data string, and prompt 
digital waveform data is retrieved from prompt audio files corresponding to the prompt 
identifiers (col. 4, line 26 to col. 5, line 33). 

Since the modified Bennett et al. and Denneberg et al. are analogous art 
because they are from the same field of endeavor, it would have been obvious to one of 
ordinary skill in the art at the time of invention to further modify Bennett et al. by 
incorporating the teaching of Denneberg et al. in order to make it easy for the user to 
follow instructions. 

30. Regarding claim 13, Bennett et al. fail to disclose the method of claim 12, 
wherein a plurality of text and slotted data strings are defined, each corresponding to a 
respective system response, further comprising: determining a current navigation 
context of the user; and selecting an appropriate text and slotted data string from 
among said plurality of text/prompt and slotted data strings based, at least in pad, on 
the current navigation context of the user. However, Uppaluru further teach the steps of 
determining a current navigation context of the user (col. 18, line 45 to col. 19, line 60); 
and selecting an appropriate text/prompt and slotted data string from among said 
plurality of text and slotted data strings based, at least in pad, on the current navigation 
context of the user (col. 18, line 45 to col. 19, line 60). 

Since Bennett et al. and Uppaluru are analogous art because they are from the 
same field of endeavor, it would have been obvious to one of ordinary skill in the art at 
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the time of invention to further modify Bennett et al. by incorporating the teaching of 
Uppaluru in order to ease the subscriber's access. 

31 . Regarding claim 14, Bennett et al. fail to disclose the method of claim 12, 
wherein a plurality of text and slotted data strings are defined, each corresponding to a 
respective system response, further comprising: identifying attributes corresponding to 
data retrieved from the enterprise data system; and selecting an appropriate text/prompt 
and slotted data string from among said plurality of text and slotted data strings based, 
at least in pad, on any attributes corresponding to data retrieved from the enterprise 
data system that are identified. 

However, Uppaluru further teach the steps of identifying attributes corresponding 
to data retrieved from the enterprise data system (col. 18, line 45 to col. 19, line 60); 
and selecting an appropriate text/prompt and slotted data string from among said 
plurality of text and slotted data strings based, at least in part, on any attributes 
corresponding to data retrieved from the enterprise data system that are identified {col. 
18, line 45 to col. 19, line 60). 

Since Bennett et al. and Uppaluru are analogous art because they are from the 
same field of endeavor, it would have been obvious to one of ordinary skill in the art at 
the time of invention to further modify Bennett et al. by incorporating the teaching of 
Uppaluru in order to ease the subscriber's access. 



Conclusion 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Huyen Vo whose telephone number is 703-305-8665. 
The examiner can normally be reached on M-F, 9-5:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Doris To can be reached on 703-305-4827. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 

Examiner Huyen X. Vo December 9, 2004 
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